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Abstract 


A comprehensive review of the literature on manoeuvring target tracking for both uncluttered 
and cluttered measurements is presented. Various discrete-time dynamical models including non- 
random input, random-input and switching or hybrid system manoeuvre models are presented. The 
problem of manoeuvre detection is covered. Classical and current filtering methods for manoeuvre 
tracking are presented including multi-level process noise, input estimation, variable dimension 
filtering, two-stage Kalman filter, the interacting multiple model algorithm, and generalised pseudo- 
Bayesian algorithms. Various extensions of these algorithms to the case of cluttered measurements 
are also described and these include: joint manoeuvre and measurement association, probabilistic 
data association and multi-hypothesis tracking. Smoothing schemes, including IMM smoothing 
and batch expectation-maximisation using the Viterbi algorithm, are also described. The use of 
amplitude information for target measurement discrimination is discussed. It is noted that although 
many manoeuvre tacking techniques exist, the literature contains surprisingly few performance 
comparisons to guide the design engineer although a performance benchmark has recently been 
introduced. 


1 Introduction 

The problem of tracking a manoeuvring target based on noisy sensor measurements has been ap¬ 
proached by a great many researchers in the last few decades. The comprehensive taxonomy of the 
existing approaches presented in this article should convince the reader that this is a very active 
research area. Manoeuvres correspond to unknown acceleration terms in the target dynamics, 
increasing the number of quantities that must be estimated compared with the constant velocity 
case. The fundamental problems in manoeuvring target tracking are (i) manoeuvre detection: the 
detection of the onset (and end) of a manoeuvre, and (ii) compensation: the correction of target 
state estimates to allow for the manoeuvre. A third problem of tracking a manoeuvring target 
in clutter is discussed subsequently. Classical techniques based on adjustments or slight modifi¬ 
cations to the discrete-time Kalman filter include increasing the process noise covariance during 
a manoeuvre, finite memory (sliding data window) and fading memory (exponential forgetting) 
filters [69]. All of these approaches increase the effective filter bandwidth so as to respond more 
rapidly to the measurement data during a manoeuvre; but they are risky in the presence of clutter 
since they increase the size of the validation gate. 

Some of the more recent approaches to manoeuvring target tracking include: adaptive Kalman 
filters [61, 39], filters using correlated and semi-Markov process noise [120, 119, 60] usually imple¬ 
mented using multiple model (partitioning) filters and filter banks [131, 58, 95, 114, 125, 141]; filters 
based on Poisson and renewal process models of acceleration [86, 128]; input estimation [35, 36] 
and input and onset-time estimation [33, 38, 116]; variable dimension filters [13]; track splitting 
filters with a finite memory constraint [147]; the generalised pseudo-Bayesian (GPB) algorithm 
[68, 1]; and the interacting multiple model (IMM) algorithm [31, 28, 96]. A second-order extension 
of the IMM algorithm was developed in [26]. 

Some researchers have developed approaches to avoid the two-stage nature of manoeuvre de¬ 
tection and compensation implied by methods like variable dimension filtering. These include 
concurrent input estimation (of acceleration and manoeuvre onset time) and variable-dimension 
filtering [103]; and an interacting multiple model filter including a bias estimator [144, 25, 3] which 
treats the acceleration as a bias term to be estimated and used for compensation of the target 
state estimate. A filter developed in [2] uses a kinematic speed constraint in the measurement 
equation for tracking constant-speed manoeuvring targets (the acceleration should be orthogonal 
to the velocity). 

A brief overview of some of these techniques is contained in [54], while a detailed treatment of 
the filter bank approach using a semi-Markov process noise model may be found in [51]. A com¬ 
parison of input/onset-time estimation with the interacting multiple model algorithm appeared 
in [13] (with follow-up comments contained in [52] and [65]), demonstrating the comparable per¬ 
formance of the IMM algorithm at lower computational complexity. Several methods based on 
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partitioning (multiple model) filters have been reviewed in the context of bearings-only tracking 
for non-manoeuvring and manoeuvring targets in [71], and their performance compared with that 
of a single Kalman filter technique. 

A technique for complexity reduction of existing manoeuvring target trackers based on the 
information form of the Kalman filter was presented in [115, 53]. Manoeuvres were modelled as 
continuous-time stochastic process with known prior density and a conditional mean estimator 
derived in [ 21 ]; the estimator is implementable when the input process has a finite number of 
discrete values with known prior probabilities. 

A comparison of Kalman and Hod filters for tracking constant-speed manoeuvring targets re¬ 
cently appeared in [137]. The conclusion reached was that an “untuned” Hoo filter does not 
outperform an appropriately tuned Kalman filter, and that the Hao filter tends to be more robust 
to mistuning. The issue of tuning in Hoc filtering is important firstly in that it requires the selection 
of an extra parameter 7 , and secondly since the filter is not realisable if 7 is made too small. 

The literature on manoeuvring target tracking is not restricted to filtering as evidenced by work 
on fixed-interval smoothing using interacting multiple models [63]; and measurement concatena¬ 
tion (block processing) applied to variable dimension filtering [43, 41, 42]. As remarked in [54], 
the variable dimension filtering approach is in fact a smoothing technique, since it requires the 
accelerating target model to be initialised retrospectively, i.e., using measurements prior to the 
instant of manoeuvre detection. 

There are also off-line approaches to the problem of manoeuvring target tracking which require 
a batch of measurement data for processing. The bearings-only tracking problem for a manoeu¬ 
vring target has been attempted via a batch method that uses simulated annealing to initialise 
an optimisation routine that determines maximum likelihood state estimates. The Expectation- 
Maximisation (EM) algorithm [19, 132, 129] has recently been applied by the author to determine 
the maximum a posteriori sequence of target manoeuvres in a multi-level white noise model [106]. 
The EM algorithm is a multi-pass technique that requires a complete track estimate for initialisa¬ 
tion. A recursive, sub-optimal version of the preceding algorithm has also been developed and has 
been shown to be closely related to the Viterbi manoeuvre tracker in [ 8 ]. 

Some less conventional approaches to manoeuvring target tracking include fuzzy systems and 
artificial neural networks. The fuzzy logicians [73, 101] have concentrated on emulating alpha-beta 
trackers, which are simplified Kalman filters using precomputed steady-state gains. Approaches 
based on artificial neural networks have considered estimation or modelling of the target acceler¬ 
ation using neural nets [4], or replacing the entire Kalman filter or PDA algorithm with a neural 
network [130, 153, 152]. The simulations reported in these articles are unconvincing or lack any 
comparison with accepted techniques. It is also unclear how the important issue of tuning or “learn¬ 
ing” should be dealt with, since algorithms based on neural networks often have many adjustable 
parameters. 

The considerably more difficult problem of tracking a manoeuvring target in a cluttered envi¬ 
ronment has also received much attention. As well as unknown acceleration terms with unknown 
onset times, the tracker must solve the additional problem of data association, that is, determining 
which of several possible measurements is to be associated with the target. In the absence of 
target manoeuvres, tracking in clutter is often achievable using extensions of Kalman filtering such 
as the probabilistic data association (PDA) filter [12] or other, more computationally intensive 
techniques [9]. These algorithms must be modified to maintain track during target manoeuvres. 
It is clear that the objectives of manoeuvre detection and data association are somewhat in con¬ 
flict, since the appearance of a false measurement can easily lead to an incorrect assumption of a 
target manoeuvre. The classical approach of nearest-neighbour Kalman filtering often suffers from 
filter divergence in cluttered environments. Recent PDA-type approaches which have been ap¬ 
plied to tracking manoeuvring targets in clutter include: Bayesian adaptive filters with multi-level 
white or coloured noise [57, 133, 134, 135]; joint measurement and manoeuvre association filters 
for a single target [82] and for multiple targets [117, 78]; variable dimension Kalman and PDA 
filters [23, 121]; interactive multiple model PDA [14, 15] and IMM integrated PDA [64]; PDA with 
“prediction-oriented” multiple models [98]; PDA filters using ranking information [100] or ampli¬ 
tude information [83, 84] to enhance the discrimination of targets from clutter. Limited-memory 


3 



(N-scan-back) filters featuring multi-level white noise with Markov switching are developed in 
[72, 140]. 

A good review of manoeuvring target tracking techniques, together with some comparative 
studies of algorithm performance is contained in [9, 10]. A MHT tracker using an adaptive re¬ 
initialisation procedure is described in [112]; this approach has been applied in target motion 
analysis of acoustic sources in clutter and performs better than the IMM at low SNR’s. A JPDA 
approach to multiple, manoeuvring target tracking using an innovations-based manoeuvre detector 
and compensator was presented in [40]; however the simulations assumed an unrealistically low 
clutter density. 

Trackers based on hidden Markov models, using the Viterbi algorithm [55] to perform an efficient 
search over a discretised state space, have been used to track targets with limited manoeuvrability 
in the presence of false alarms and other interference [89, 46]. In another paper [47] a HMM- 
based tracker is presented, but the emphasis is on the ability of the technique to handle non¬ 
linear measurement models rather than on manoeuvring in clutter. The discrete state-space HMM 
trackers developed in [123, 150, 151] for single and multiple frequency line tracking, which work 
for time-varying tones, are known to be adaptable to the cluttered measurement case by suitable 
modification of the observation probability density, although this is not explicitly stated therein. 
Barniv’s dynamic programming algorithm [17, 18] for tracking low SNR targets in infra-red image 
sequences was extended in [6] to allow for cluttered measurements. 

The Viterbi algorithm can also be applied to tracking problems without discretisation of the 
state and measurement spaces. A first approach along these lines is contained in [111] in the 
context of sonar tracking. A subsequent study, reported in [107, 108, 79], extends the previous 
work to include automatic track maintenance and measurement gating. This technique, called 
Viterbi data association (VDA) has been applied successfully to the data association problem 
in over-the-horizon radar (OTHR) and more recently extended to allow for manoeuvring targets 
[80, 81] based on the two-stage Kalman filter. Modifications to the transition cost function of this 
data association technique to allow for tracking of a manoeuvring target were also briefly described 
in [111] but have been found to be difficult to tune, at least in OTHR scenarios. 

The structure of the paper is now described. Section 2 introduces several classes of dynamical 
model for manoeuvring targets which have been used in radar and sonar. Section 3 deals with 
the problem of manoeuvre detection, that is, estimation of the onset time of a target manoeuvre 
based on noisy observations of the target state. In section 4 the main methods of manoeuvring 
target tracking are summarised. We cover the extension to the case of cluttered measurements in 
section 5. In section 6 we summarise our observations concerning the manoeuvring target tracking 
problem based on the surveyed literature. 


2 Dynamical Models for Manoeuvring Targets 

In the following sections we review the literature on manoeuvring target tracking, focussing first 
on the case of zero false alarms and later on the cluttered measurement case. The starting point 
for our survey is a description of dynamical models for manoeuvring targets. These fall into several 
broad categories depending on how the manoeuvre dynamics x{k) are modelled [9, 10]. We use 
y{k) to denote the target measurement at time k and to denote the measurement set to time 
k. We assume familiarity with the discrete-time Kalman filter and smoother, and with Bayesian 
estimation theory (refer to, for example, [5, 10]). 

1. Systems of the form 


a;(A:-I-1) = F{k)x{k) + G{k)u{k) + v{k) (1) 

y{k) = H{k)x{k) + w{k) 

where the unknown input (acceleration) process u{k) is a random process and v{k) is the 
(small) filter process noise term, which controls the filter bandwidth. In this kind of model 
the target acceleration u{k) is modelled as an additional process noise term. Usually a finite- 
state process is assumed to describe the possible types of target manoeuvre as is the case in 
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the Markov and semi-Markov process noise models in which the acceleration switches between 
several possible levels according to given transition probabilities and with given distributions 
governing the switching times for each level. 

2. Systems with unknown inputs: 

x{k + l) = F{k)x{k)+G{k)u{k)+v{k) (2) 

y{k) = H{k)x{k) + w{k) 

where the input u{k) is deterministic but unknown and must be estimated. Often u{k) is 
assumed to be piecewise constant, such as in the multi-level noise case 

{ F{k)x{k) + G{k)ui{k) -\- v{k) for model 1 
F{k)x\k) + G{k)u 2 {k) + v{k) for model 2 

. 

F{k)x{k) -f G{k)ur{k) + v{k) for model r 
y{k) = F[{k)x{k) + w{k) (3) 

where it is assumed that only one of the r possible target models in effect at any one time. 
3. Multiple dynamic models 

x{k + l) = F{k;M{k))x{k)+v{k;M{k)) (4) 

y{k) = F[{k; M{k))x{k) + w{k; M{k)) 

in which the model type M(k), also called the mode, is a finite-state Markov chain taking 
values in the set {Mi,..., Mr}. The transition probabilities of the Markov chain are usually 
assumed to be known and the modes are mutually exclusive. 

Systems (3) and (4) are called hybrid systems since they contain both continuous-valued states 
and discrete parameters (the model type or input level). In the control literature, system (3) is 
referred to as a switching control system, and system (4) a jump-linear system. In tracking, unlike 
control theory, the input term u{k), whether deterministic or random, is unobservable and must 
be estimated or allowed for by switching to an appropriate model. 

The particular model structures can be chosen to reflect the expected target dynamics. This 
might include models such as constant velocity, constant acceleration, constant turn-rate and 
constant speed (co-ordinated turn), etc. The filter process noise v{k) is used to represent small 
variations in acceleration about the nominal target trajectory, while the manoeuvre input u{k), 
or mode M (k) in the multiple model case, is used to represent significant levels of acceleration. 
The interested reader is referred to [20, 146, 145, 2, 29] for further examples of target manoeuvre 
models. 

It is well known that optimal (Bayesian or MAP) state estimation for hybrid systems generally 
requires filters with increasing memory requirements. This has led to several sub-optimal filtering 
techniques with bounded complexity such as the interactive multiple-model algorithm [31] and the 
class of generalised pseudo-Bayesian algorithms [1, 37]. Readable accounts of estimation techniques 
for switching systems include [104], and [138], which covers partitioning filters, the GPB algorithm 
and the random sampling algorithm. An IMM algorithm for semi-Markov switching systems was 
developed in [34]. We return to a discussion of filters for hybrid systems in section 4. 


2.1 Correlated Process Noise (Singer) Model 

The archetypal work on modelling a manoeuvring target was done in [120]. Target manoeuvres are 
characterised by large deviations from a constant-velocity trajectory corresponding to a random 
acceleration a(t). Thus, in one dimension of motion, if the components of the state vector x{t) are 
xi{t) - the target displacement and X 2 it) - the velocity, the target dynamics are described by 


x{t) 


0 1 
0 0 


x{t) + 


I a{t). 
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Manoeuvres are parametrised by an acceleration variance cr^ and a time constant l/a. During a 
manoeuvre, the target acceleration is correlated with autocorrelation function 

r(T) = E{a(t)a(t + r)} = cr^e““l^l. 

The same autocorrelation results from a linear system 


d{t) = —aa{t) + v{t) 


driven by white noise v{t) with autocorrelation function 2aa‘^6{t) ((5(-) is the Kronecker delta 
function). Augmenting the state with the target acceleration a{t), the dynamical model for the 
manoeuvring target becomes 



■ 0 

I 

0 


■ 0 ■ 

x{t) = 

0 

0 

1 

x{t) -1- 

0 


0 

0 

—a 


1 


(5) 


where v{t) is white noise with variance 2aa^. 

The continuous-time model can be discretised in the usual manner [7] by uniform sampling 
with period T. The resulting discrete-time model is (with a slight abuse of notation) 


x{k) 
x{k + 1) 


target displacement at time kT 
target velocity at time kT 
target acceleration at time kT 

Fa{T)x{k) + u{k) 


( 6 ) 


where the transition matrix Fa{T) may be shown to be 


FciT) 


1 T (aT-l-fe-“'^)/a2 
0 1 (l-e-“^)/a 

0 0 e-“^ 


(7) 


and where u{k) is a zero-mean white noise sequence with covariance matrix Q{k) whose elements 
qij are given by 


gii = cr^[l-e"2“'^-f 2aT-f 

l-2e““'^-f2aTe"“^-2ar-fa2r2]/a^ 

(713 = (T^[l-e-2“^-2aTe-“^]/a2 

922 = (Jm[4e““^ - 3 - e“^“^-I-2 q;T]/q;^ 

923 = (T^[e-2“^ + l-2e-“^]/a 

933 = (T^[l-e-2“^]/a. 


( 8 ) 


The manoeuvre parameter a may be chosen to model various classes of target manoeuvre, e.g., 
lazy turn, evasive manoeuvre, etc. If the sampling time is sufficiently small compared with the 
manoeuvre parameter, be., aT 4, the following asymptotic form of Q(k) may be used: 


Q{k) = 2aal^ 


T^/20 

TVs 

TV 6 


TVs 

TV3 

TV 2 


TV 6 

TV 2 

T 


If noisy measurements of the target are available, viz. 


y{k) = F[{k)x{k) + w{k), w{k) ~ A^{0, R{k)}, 


(9) 


where N{m,C} denotes a Gaussian density^ with mean m and covariance C, then it is straight¬ 
forward to derive a Kalman filter for minimum mean-square error estimation of the manoeuvring 
target’s state (see section 4). 

^We will also use N{y, m, C} to denote the value at y of the Gaussian density with mean m and covariance C. 
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The Singer model has been extended in [62] to reflect the tendency of targets to have a constant 
forward speed with acceleration normal to their velocity. Under this model the turn rate is as¬ 
sumed to be uniformly distributed. A higher order “jerk model” of manoeuvring targets has been 
developed in [92]. This model is obtained by discretising a system similar to (5) the state of which 
contains a third-order derivative of the position. It is claimed that this model more accurately 
reflects the behaviour of agile targets. The filter for this fourth-order model requires three-point 
initiation with the initial jerk estimate taken as zero. 

2.2 Semi-Markov Correlated Process Noise Model 

The correlated process noise model of Singer was bnilt on in [95, 94, 58, 114]. By allowing the 
correlated process noise to have a randomly switching mean value, rather than a zero mean value, 
a more realistic model of a manoeuvring targets was obtained. This model is also more economical 
than the white Gaussian process noise with randomly switching mean since it requires fewer mean 
values for accurate modelling than the latter. The system model for a target with state x{k) and 
measurement process y{k) is in this case 

x{k + l) = F{k)x{k)+G{k){u{k)+v{k)) (10) 

y{k) = H{k)x{k) + w{k) 

where u(k) is a random process taking values in a finite, discrete set {ui,... ,un}', v(k) is the 
correlated Gaussian (Singer) process noise; and w{k) is a white Gaussian measurement noise. The 
Singer process noise covariance and the measurement noise covariance are assumed to be known. 
Since physical target manoeuvres tend to be sustained for a certain “holding” time, the randomly 
switching mean is modelled as a semi-Markov process [67] (Vol. 2), and this is illustrated in Fig. 
1. In addition to the transition probabilities for a (time-invariant) Markov chain 

Pij = Pr{M(fc -I- 1) = Uj\u{k) = Ui}, 

a further set of probabilities, the holding-time distributions, must also be specified: 

Pi{k) = Pr(transition from Ui \ k successive time instants spent in Ui). 



Figure 1: Finite-state, discrete-time semi-Markov model of manoeuvring target acceleration. The model 
parameters are the transition probabilities pij and the holding-time distributions Pi{k) which determine 
the probability of switching as a function of the time spent in the current manoeuvre state. 

To simplify the characterisation of the semi-Markov process, the holding-time distribution is 
often assumed to be an monotonically increasing (e.g., exponential) function of time so that a 
transition from manoeuvre state Ui becomes more likely as the time spent in Ui increases. In 
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practice, to reduce the number of free parameters in the model, it may be assumed that each 
possible manoeuvre state is held for a random holding-time, with the transition matrix of the 
Markov chain having diagonal elements near unity and equal off-diagonal elements [95]. 

Minimum variance (conditional mean) state estimation of the manoeuvring target system (10) 
requires a filter with exponentially increasing memory [ 1 ]. Approximate conditional mean filtering 
is therefore necessary and this take the form of a truncated, weighted sum of Kalman filter estimates 
matched to the possible manoeuvre sequences. By forcing the covariance update for each filter in 
the bank to be identical, it is possible to reduce the filter complexity to that of a Kalman filter 
with N state updates [51, 94] (see section 4.1). 

2.3 Poisson Processes and Renewal Models 

Target manoeuvres have been modelled as a finite-state jump process with Markov transitions [ 86 ]. 
The theory for these models is that of discrete-state, continuous-time Markov processes [22] and is 
beyond the scope of this article. We will however summarise the main points of these alternative 
approaches to manoeuvre modelling and the different filter structures which arise. 



Figure 2: Discrete-state Poisson process manoeuvre model. 

Consider the case of motion in one dimension represented by the discrete-time system 

x{k + 1) = Fx{k) + G(u{k) + v{k)), v{k)^N{0,Q} 

y{k) = Hx{k)+w{k), w{k)'^N{0,R} 

where u{k) is a scalar process corresponding to the jumps from one manoeuvre state to another, 
and the other symbols have their usual meanings. Let the possible manoeuvre states, shown in 
Fig. 2, be denoted {0, ±1, ±2,..., ±n}, with state 0 corresponding to a constant-velocity target. 
Note that transitions are only allowed between adjacent manoeuvre states, and the transition 
rates (probability per unit time) between states i and j are assumed to be known constants. 
If Pi(k) = Pr{t 6 (fc) = i} denotes the probability that the target is in manoeuvre state i at time k, 
then for i ^ ±n, 

Pi{k -I- A) = Ai_i,iApi_i(fc) -I- (1 - Ai,i+iA - Ai+i,iA)pi(fc) -|- Ai+i,iApi+i(fc) 

where A is a small time increment. Similar recursions hold for the two states at the end of the 
chain i = ±n. A (constrained) linear, minimum variance filter for the state estimates is then 
derived based on noisy observations. The state and covariance update for the filter are the same as 
those in the Kalman filter, but the prediction equations for the state and covariance are different. 
For example, the state prediction is 

x{k + l|fc) = Fx{k\k) F Gb{k + 1) 

where the term b{k+l) is the predicted acceleration from the Poisson process, and may be computed 
using the transition rates A^ and posterior manoeuvre state probabilities PT{u{k) = i\Y^). The 
probabilities Pr('u(A:) = f|K^) presumably satisfy a recursion, although this is not provided in [86]. 
The covariance prediction is of the form 

P{k + l\k) = FP{k\k)F' + GQG’ + GBG’ 

where B is a diagonal matrix determined from the Pr{M(fc) = i} and the Pr{u{k) = i\Y^) proba¬ 
bilities. 



No comparison with the classical manoeuvre modelling techniques is provided. More impor¬ 
tantly, it is unclear how robust the filter is when the transition rates of the manoeuvre process are 
not precisely known. 

Finite-state renewal process models of target manoeuvres have been investigated in [128]. Re¬ 
newal processes [45] are generated by the differences between consecutive transition times (or 
sojourn times) of a point process. For example, if {ti, is a Poisson process, then 

{ti = ti,T 2 = t 2 — ti,... ,Tn = tn — tn- 1 ,...} is a renewal process [102]. Renewal processes, which 
are Markov processes, are characterised up to an initial distribution by a matrix of transition 
probabilities P between the manoeuvre states {ui,... ,un}, and a set of sojourn-time distribu¬ 
tions pi(T\u{k) = Ui). Thus both the transitions between manoeuvre states and the time spent in 
each state following a transition are random. 

A general characteristic of Markov and semi-Markov manoeuvring target models is that the 
sojourn times (be., the time spent in each manoeuvre state) are exponentially distributed. Thus 
the sample paths from such processes can contain manoeuvring segments of very short duration, 
which may not be physically realistic. 

A model for an agile target that executes co-ordinated (constant turn rate at constant speed) 
turns at instants governed by a renewal process in developed in [128]. A dynamical model for 
constant-turn rate motion in the {xi,X 2 ) plane is [10] 


X\ = —UJX2, X2 = —LOXi 


where uj is the 
then^ 


(constant) angular velocity. 


Xi (t) 


X2(t) 


X'l (t) 


_ X2{t) 



0 1 

0 0 

0 0 

0 uj{t) 


The state-space model for the manoeuvring target is 


0 

1 

0 



Xi{t) 


■ 0 

0 ■ 


X2{t) 

+ 

0 

0 


Xi{t) 

1 

0 


_ X2{t) 


0 

1 


( 11 ) 


where v{t) is a white noise process and Lo(t) a finite-state renewal process modelling the random 
rate and duration of the turns. 

The transition probabilities of the renewal process are assumed known. Each sojourn-time 
distribution is characterised by Gamma density with known parameters 


p^{t) 


exp(-At) t > 0 
0 otherwise 


where r > 0 controls the shape of the density and A > 0 governs the time scale. Notice that for 
r = 1, the Gamma density reduces to an exponential PDF, but for r > 0 the Gamma density 
function is zero at the origin, so that very short sojourns in the manoeuvre states are uncommon. 

The model (11) is not well suited to extended Kalman filtering since it is has non-Gaussian 
noise multiplying the state components. The dynamical process can be approximated by a Gaus¬ 
sian process with power spectral density (PSD) matched to that of the equilibrium PSD of the 
non-stationary process generated by (11). Analogously to the Singer case, a state-space system 
augmented by the manoeuvre uj{t) process is obtained. A second order matching to the PSD is re¬ 
quired for a reasonable approximation to the original system, and depends on the time constant of 
the matching hlter and the turn-rate variance E{w^}. The dimension of the equivalent continuous¬ 
time Gauss-Markov system is then six and this system is amenable to extended Kalman hltering. 
Results of simulations performed in [128] indicate that the performance improvement from this 
matched EKF method is not commensurate with its increased complexity for single-sensor sys¬ 
tems. However, the performance gain is significant for image-enhanced systems [127] such as a 
microwave radar teamed with an infra-red imaging sensor. It should be stressed that the renewal 
model of manoeuvres was developed for highly agile targets which are not well modelled by the 
conventional semi-Markov approach. 

® Strictly speaking, we should write this as a stochastic differential equation since the derivative of the Brownian 
motion term v is not defined. 
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3 Manoeuvre Detection 


Many manoeuvring target tracking techniques require a method for detecting the manoeuvre before 
compensation of the state estimate can be accomplished. This is the case in approaches which use 
a “quiescent” constant-velocity model such as the variable-dimension filter [9, 13] which uses a 
low order Kalman filter to provide high accuracy tracking of nearly constant velocity targets, and 
switches to a higher order filter once the manoeuvre is detected. Manoeuvre detection is also used 
in an adaptive Kalman filter to switch to a higher level of process noise during a manoeuvre. The 
input estimation technique [35] also requires knowledge of the manoeuvre onset time. The IMM 
algorithm (section 4.4) and its variants do not require separate manoeuvre detection logic. 

Manoeuvre detection can be formulated as a hypothesis testing problem and implemented by 
likelihood ratio test (LRT) based on the Kalman filter innovations. The central idea is that the 
sequence of Kalman filter innovations are white Gaussian random variables for a correctly modelled 
system. The probability of the measurement sequence is then expressible solely in terms of the 
innovations and their covariances. The statistics of the Kalman filter innovations can therefore be 
checked to see if they are consistent with the hypothesised model of the target dynamics. 

Likelihood ratio tests and other forms of hypothesis testing are described in detail in [139]. The 
likelihood ratio test (LRT) arises from the Neyman-Pearson criterion and uses (i) a test statistic, 
and (ii) a threshold for the test. If the test statistic, which is a function of the measurement data, 
exceeds the threshold, a manoeuvre is declared; otherwise no manoeuvre is declared. Assuming 
that the probability distribution (of the test statistic) under the manoeuvre and non-manoeuvre 
hypotheses are known, fixing a value for the probability of false alarm Pm fa determines the thresh¬ 
old for the test. The probability of manoeuvre detection Pmd [131] and can then be calculated for 
the chosen threshold. There is clearly a compromise since we cannot make Pmd arbitrarily large 
without also raising Pmfa- 

The following description of an innovations-based manoeuvre detector is from [9]. If v{k) 
denotes the Kalman filter innovation, i.e., the difference between the measurement and its predic¬ 
tion, and S{k) is the corresponding innovations covariance matrix, then the normalised squared 
innovation is defined as 

e(fc) = F {k)S~^ {k)h'{k). (12) 

In a correctly tuned KF with Gaussian inputs, e(fc) is a Xny random variable where Uy is the 
number of measurement components. The modified likelihood function of the Kalman filter is 
given by 

k 

Kk)='^e{k) (13) 

i=l 

and forms the test statistic for manoeuvre detection. This function can be made responsive to re¬ 
cent data by applying an “exponential forgetting factor” [87] yielding the fading-memory likelihood 
function 

k 

pik) = Y,a'^-^e{z) (14) 

which satisfies the recursion 

p{k) = ap{k — 1) -I- e(fc). (15) 

The forgetting factor a (not the same as in the Singer model) is between 0 and 1, and yields 
an effective memory length of 1/(1 — a). Equivalently, the modified likelihood function can be 
implemented as a sliding window sum. The mean value of p{k) can be shown to be nyl(l — a) 
[9]. The detection test compares p{k) to a threshold to determine whether or not a manoeuvre 
has occurred. Similarly, a hypothesis test on the significance of the acceleration estimate from the 
manoeuvring Kalman filter is used to determine when the manoeuvre has terminated. 

It is important to detect manoeuvres as soon as they occur, but there is a trade-off between 
the detection delay and the probability of falsely declaring that a manoeuvre has occurred. In 
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[142] a method was proposed to minimise the delay in manoeuvre detection. Their technique uses 
a sliding window over which the Kalman filter residuals are summed: 

k 

^L{k) = 

i=k — L~\-l 

The random variable D]^{k) is normally distributed with zero mean for a constant-velocity target 
but has a non-zero mean if the target is accelerating (the mean can be calculated from the system 
matrices and the target acceleration over the window). For a given false alarm probability Pfa it is 
possible to compute the average manoeuvre detection delay, which depends on the system matrices, 
the target acceleration, Pfa and window length L. With all parameters except L fixed, it is then 
possible to determine numerically the optimum window length that minimises the manoeuvre 
detection delay. 

In tracking and other practical scenarios, the probability densities for hypothesis testing may 
not be precisely known, rendering it difficult to determine a test statistic and threshold for the 
likelihood ratio test. Moreover, incorrect modelling of the required probability densities decreases 
the power of the test, z.e., its ability to detect a manoeuvre when one has occurred. 

The same remarks apply to generalised likelihood ratio tests (GLRT’s) where the probability 
densities in question depend on an unknown parameter {e.g., the acceleration) or composite hy¬ 
pothesis. In a GLRT, maximum likelihood estimates of the parameter are used in a LRT to make 
a decision on which hypothesis is true. An example of an application of a GLRT in manoeuvre 
detection may be found in [91, 77] and is summarised in [51]. 

If it is desired to estimate both the onset time of the manoeuvre and the target acceleration at 
this time, the following hypothesis test on the Kalman filter innovation sequence can be set up 

PIi : v{k) = r'o(fc) + Gu(t) 

Hq : v{k) = vt){k) 

where the acceleration u{t) is zero for k < t and constant thereafter, and ^o(fc) is the residual for 
a constant-velocity target. A sufficient statistic for the test is 

p{v{k)\Y'=,Ho) 

which is implemented by discretising the possible accelerations and onset times u and t and passing 
the hlter innovation through a bank of low-pass filters matched to the possible combinations of 
u and r. The optimum estimate of u and r corresponds to the hlter with the largest magnitude 
output. Although this technique estimates both the acceleration and onset time of the manoeuvre, 
the detection is delayed by the memory of the low-pass hlter, and the complexity of the algorithm 
is substantial. 

Several techniques exist in the literature for designing more robust detection tests, these include 
the marginalised likelihood ratio test (MLRT) [59] and a robust LRT reported in [148]. It seems 
that these techniques have so far not been applied in manoeuvring target tracking. The MLRT is 
designed for systems undergoing sudden changes when the onset time and magnitude of the change 
are unknown. It uses marginalisation to remove the dependence of the probability densities on 
the parameters and also does not require a threshold. Despite this advantage, the MLRT has a 
high complexity and also requires data smoothing. The robust LRT in [148] focusses mainly on 
developing a hypothesis test for nonlinear dynamical systems in low signal-to-noise ratio conditions. 


4 Manoeuvring Target Tracking Techniques 

In this section we review the existing techniques for tracking a manoeuvring target in the absence 
of clutter. The literature on this subject is replete with claims of superior performance; however, 
many simulation studies are unconvincing or fail to take account of existing approaches in their 
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performance comparisons. The general absence of accepted tests for manoeuvring and multi¬ 
target tracking has been noted in [27]. Recently a benchmark problem for manoeuvring target 
tracking with a phased-array microwave radar was established [27]. This benchmark problem 
requires the tracker to initiate and maintain track on manoeuvring targets within a minimum 
number of scans (on average), subject to a maximum track loss probability of 4%. Test targets are 
subject to position and manoeuvrability constraints while fading, missed detections, beam shape 
and resolution are taken into account. 

The Kalman filter is the optimal (MMSE) state estimator for linear observations of a target 
with known dynamics and white Gaussian process and measurement noise. However, as soon as 
a target changes its dynamics, e.g., by executing a manoeuvre, the Kalman filter estimates may 
diverge causing track loss. This divergence is due to incorrect modelling of the target dynamics, 
rather than finite numerical precision, and is the chief difficulty in manoeuvring target tracking. As 
summarised in [51], the approaches to manoeuvring target tracking using Kalman filters generally 
fall into 5 classes: 

1. re-initialisation of the Kalman gain (to reduce the effect of past measurements); 

2 . increasing the process noise covariance; 

3. increasing the state estimation covariance; 

4. augmenting the filter state with acceleration terms (variable-dimension filter); 

5. switching to or applying heavier weighting to another filter in a bank of Kalman filters 
(multiple-model approaches). 

Once a manoeuvre is detected, it becomes necessary to take one of the actions above in order 
to correct the state estimate and its covariance. Approaches 1-3 above all involve changing the 
parameters of the Kalman filter. For a given application, the adjustment required will depend 
on the type of manoeuvre, the sampling time, the measurement noise, etc. Usually, trial-and- 
error methods must be used to tune the Kalman filter for manoeuvre tracking. Approaches 4 and 
5 involve changing or adapting the filter structure, and we describe these later in some detail. 
The following sections cover the major filtering techniques and structures for manoeuvring target 
tracking, including: optimal Bayesian filters for multi-level (Markov) process noise and multiple 
models; single-scan and multiple-scan approximate filters including the interacting multiple-model 
(IMM) algorithm and the generalised pseudo-Bayesian (GPB) filter; input estimation; the variable 
dimension filter; the two-stage Kalman filter (which treats the acceleration as a bias term); the 
IMM smoother; and an expectation-maximisation approach. The multi-hypothesis tracker (MHT) 
[113] is also of importance in manoeuvring target tracking, and we comment on this in section 5.6. 

4.1 Optimal and Approximate Filters for Markov Noise 

The optimal (Bayesian) filter can be derived for tracking a manoeuvring target whose accelera¬ 
tion u{k) is represented by a finite-state Markov chain with state space {ui,... ,un} and known 
transition probabilities pij. The system model is, as in equation (3), 

x{k + l) = Fx{k)+Gu{k) + Gv{k), v{k) N{0,Q{k)} 
y{k) = Hx{k)+w{k), w{k) N{Q,R{k)} 

where the state x{k) contains position, velocity and acceleration terms with corresponding F 
matrix (7) and v{k) is the zero-mean Singer noise component with covariance Q given by (8). In 
this derivation we will not use the semi-Markov nature of the manoeuvre process u(k). As in [51], 
we denote the jth sequence of possible target manoeuvres by 

= {ujj,..., Uj ^}. 
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From Bayes’ rule, the conditional mean estimate of x{k) based on the measurements contained in 
is expressible as 

N>‘ 

f(A:|fc) = ^ (16) 

with conditional estimates defined as Xi{k\k) = E{x{k)\V,^ ,Y^}. Alternatively, we could take the 
MAP estimate, i.e., the Xi{k\k) for which Pr(f2*|F^) is maximum. In either case, the optimal 
estimate is seen to require the evaluation of terms which implies that the optimal tracker has 
exponentially increasing computational requirements, as illustrated in Fig. 3. 



X_ll(2) 


X_12(2) 


X_21(2) 


X_22(2) 


ESTIMATE E X_i(l) E X_ij(2) 

Figure 3: Idea behind branching filters {e.g., MHT) and optimal Bayesian algorithms with two possible 
manoeuvre models Ml or M2 at each time instant. The MAP estimate is obtained by taking the most 
probable manoeuvre sequence at time k, while the MMSE estimate corresponds to a weighted sum of all 
conditional state estimates at a given time. Sub-optimal approximations are obtained by merging common 
path histories and deleting unlikely branches. 

A natural way of reducing the complexity of the filter is to approximate the Af^“^-term mixture 
PDF of the state at time fc — 1 by a single Gaussian density, thus obtaining a filter with 0{N) 
complexity [95]: 


N 

x{k\k) w Ci{k) Xi{k\k) 

i=l 

c,{k) = Pr(u(fc) =u,|ry 

where Xi{k\k) = E{x{k)\u{k) = Ui,Y^}, which is generally not the same as E{x{k)\fl'^,Y^}. The 
conditional state estimates are obtained by Kalman filtering in the usual manner: 


Xi{k\k) 

Xi{k\k — 1) 
yi{k\k - 1 ) 
W{k) 
Sik) 
P{k\k-1) 
P^{k\k) 


x,{k\k - 1) + W{k)[y{k) - y^{k\k - 1) 
Fxi{k — l\k — 1) -I- Gui 
Hxi{k\k — 1 ) 

P{k\k-l)H'S-^{k) 

HP{k\k-l)H' + R{k) 

FP{k - l\k - 1)F' + GQ{k)G' 

{I -W{k)H)P{k\k-l) 
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where Pi{k\k) is the error covariance associated with Xi{k\k). The net covariance of the state 
estimate is obtained using a standard formula for Gaussian mixtures [10] 

N 

P{k\k) = Ci{k){Pi{k\k) + Xi{k\k)xi{k\ky} — x{k\k)x{k\ky 

i=l 

= (7 - W{k)H)P{k\k c,{k)cj{k)xi{k\k)xj{k\ky 

where we have used the fact that the Ci{k) sum to unity, and the assumption that the noise 
covariances Q and R are identical across all manoeuvre modes. To evaluate the posterior manoeuvre 
probabilities Ci(fc), a recursion can be derived using Bayes’ rule: 

Ci{k) = Y’Y{u{k) =Ui\y(k),Y'^~^) 

= A~^p{y{k)\u{k) = Ui, Pi{u{k) = 

writing the normalising constant as A“^. Furthermore the above terms are by assumption 

p{y{k)\u{k) = Ui, Y'"~^) = N{yi{k\k - l),S{k)} 

and 

N 

Pi{u{k) = Pr('u(fc) = Ui\u{k — 1 ) = Uj, Y^~^) Pr('u(A: — 1) = Uj\Y^~^) 

i=i 

so that the desired recursion is 

N 

Ci{k) = A~^N{yi{k\k - 1), S{k))'^pjiCj{k - 1 ). 

i=i 

Finally the state estimate update can be written 

N 

x{k\k) = Ci{k)xi{k\k) 

i=l 

N N 

= y^ Ci{k)xi{k\k — 1) + y^ Ci{k)Gui 

i=l i=l 

= (7 — W{k)H){Fx{k — l\k — 1) + Gu{k)) + W{k)y{k) 

where u{k) = Ci{k)ui is the estimated target acceleration at time k. Notice that the Kalman 
gain and covariances for the conditional state estimate are identical, which greatly simplifies the 
filter update. 

4.2 Input Estimation 

The input estimation technique treats the target acceleration as deterministic bu unknown vector. 
The ensuing description of the technique is from [9] and is based on [35]. Assume a system model 
of the form 

x{k + l) = Fx{k)+Gu{k)+v{k), v{k) N{{),Q{k)} (17) 

y{k) = Hx{k)+w{k), w{k) ^ N{0, R{k)} 

for known matrices F, G, 77 and noise covariances Q, R. The acceleration sequence {■u(/)} is 
assumed to be zero for 1 < fc, and non-zero ioi k < I <k F s. Denote the state estimates from the 
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constant-velocity u{k) = 0 target model as xo{k\k) and those for (17) as x{k\k). The prediction of 
these estimates is accomplished via 

xo{i + l|i) = F{I - W{i)H)xoii\i - 1) FW{i)y{i). (18) 

Denote the estimator transition matrix by $( 1 ) = F{I — W{i)H) and the i-step transition matrix 

by 

i 

$(fc, *) = ^{j) = $(t)$(t -1) • • • <i>(fc) 

j=k 

Starting with xo{k\k — 1) = x{k\k — 1), and propagating the difference equation (18) [70] we obtain 
the constant-velocity predictions for i = fc,..., fc -|- s — 1 as 

I 

xo(i -b l|i) = <^{k,i)x{k\k - l) + '^<P{k,j - l)FW{j)y{j), (19) 

j=k 


whereas the correct predictions are in fact 


I 

x{i + l|i) = <^{k,i)x{k\k - 1) + '^<^{k,j - l)iFW{j)y{j) + Gu{j)) 

j=k 

with innovations vli -I- 1) = y(i -b 1) — F[x(i -b Iji). The innovations are white, zero-mean and have 
covariance S{i + 1) (the innovations covariance in the Kalman filter for (17)). The innovations 
sequence of the mistuned (zero-velocity) filter is 

I'oii -b 1) = y{i + 1 ) - Hxo{i + 1 |*). 

By assuming that the accelerations u{j) = u are constant over the interval [k, k + s — 1], we have 
that 

i 

r'o(* + 1) = '!'(* + l)^ + + 1), '!'(*) = - 1)0 

j=k 

which results in a standard least-squares problem for the unknown input vector u. Now write this 
as 

Vq = .^{ 0 , S} 

where = [i^{k -b 1),... , v{k + s)]', S = blockdiag(S'(i)), etc. The least-squares estimate for u is 
then 

Vo 

and has mean-square error P„ = The same solution can of course be obtained by 

recursive least-squares. The acceleration estimate u can be employed to test the manoeuvring 
hypothesis, with a manoeuvre declared if 

d{u) = u'P~^u > c 

for some threshold c chosen from a table for a given false-alarm probability (n„ is the dimension 
of the input vector). 

When a manoeuvre is declared, the constant-velocity state estimate and its covariance are 
corrected according to 


a;(A:-b s-b IjA:-b s) = a:o(fc-b s-b Ij/c-b s)-b Mfi 
P(fc-bs-bl|A:-bs) = P(A:-bs-bl|A:-bs)-bMP„M' 

where M = ^{k,j — 1)G. The manoeuvre is declared finished when the correction becomes 

insignificant. The key parameter in the algorithm is the window length s, the choice of which 
depends on the sampling interval. 


15 



Various modifications of the input estimation technique have appeared [53, 33, 103]. The tech¬ 
nique does not require retrospective corrections to the estimate, and reportedly yields reasonable 
performance [54], but at a relatively high complexity. Input estimation was compared with the 
IMM hlter in [16, 52, 65]. The assumption of known manoeuvre onset time is addressed in [33] 
where a bank of filters was used to estimate the onset time of the manoeuvre— increasing the 
complexity of the technique by at least an order of magnitude. It is claimed [53] that enhanced 
performance can be obtained at significantly reduced complexity using the information form of the 
Kalman filter [5]. In [33] it is suggested that the technique is well-suited to implementation in the 
framework of a multi-hypothesis tracker (see section 5). 

4.3 Variable-Dimension Filter 

The idea behind variable-dimension filtering was already mentioned in section 3. A constant- 
velocity model for the target is adopted during quiescent (non-manoeuvring) tracking periods. 
Manoeuvre detection is accomplished by monitoring a fading-memory average of the normalised 
residuals from the Kalman filter. Once a manoeuvre is detected, the constant-velocity model is 
abandoned and the algorithm “switches” to an augmented model such as the one-dimensional, 
mean-jerk acceleration (Wiener process noise) model: 

x{k + 1) = Fx{k) + Gv{k), v{k) ~ N{0, Q{k)} 


r 1 T T‘^/2 1 

■ TV20 

r^/s 

T^/6 ' 


0 1 

T 

, Q = TVs 

r3/3 

rV2 q 

(20) 

0 0 

1 

r3/6 

rV2 

T 



where the quantity ^^IqT) models the change in acceleration over the sampling interval [9]. Alter¬ 
natively the Singer model in section 2.1 could be used. For a manoeuvre detector with (effective) 
window length s declaring a manoeuvre at time k, the augmented model must be initialised at 
time k — s, that is, retrospectively. In [54] it is pointed out that, strictly speaking, the variable- 
dimension filter is not a filter due to the latter requirement. A Monte Carlo comparison of the 
variable-dimension and input estimation approaches appears in [9]: the variable-dimension filter 
performed better on average than input estimation, despite the latter being considerably more 
complex; a two-level white noise model, the simplest algorithm of the three, performed better than 
the input estimation technique and only slightly worse than the variable-dimension filter. 

4.4 Optimal and Approximate Filters for Jump-Linear Models 

In contrast to the multiple model approaches based on multi-level noise or Markov inputs, the 
focus of this section is on variable structure systems of the type (4), repeated here: 

x{k + l) = F{k;M{k))x{k)+v{k;M{k)), v{k) N{0,Q{M{k))} (21) 

y{k) = H{k; M{k))x{k) + w{k; M{k)), w{k)N{0, R{M{k))}. 

The “mode process” M{k) is a finite-state Markov chain taking values in {Mi, ..., Mr} with known 
transition probabilities pij. The notation Mi{k) signifies that model M{k) = Mi is assumed to be 
in effect during the time interval [k — 1, fc). We also denote by Mj^ the Ith mode history, in other 
words 

Mt = {Mq(l),..., Mi,ik)} = {Mt\Miik)}. 

There are a total of r^ possible mode histories at time k. We can derive the optimal Bayesian 
(MMSE) state estimator for (21) by decomposing the posterior PDF of the state as follows: 

r*‘ 

p(:r(A:)|K'=) ( 22 ) 
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where ni{k) = Pr(M/'|y^) are the mode probabilities. A recursion on the mode probabilities is 
obtained in a similar manner to section 4.1 as 

= 5-ip(y(fc)|Mf,r'=-i)Pr(Mi(fc)|M,'=-\y'=-^)Pr(Mi=-i|r'=-^) 

= S~^Piyik)\Mi^p.s{k - 1). 

Note that each term p{y{k)\Mj ^involves running a Kalman filter on the entire mode history 
up to time k. 

Computation of (22) is clearly infeasible since it involves a sum with an exponentially growing 
number of terms. It is therefore necessary to consider sub-optimal “N-scan-back” approaches that 
“combine” mode histories prior to time k — N [10]. This amounts to approximating the mixture 
PDF of the state (or measurement) by a single Gaussian, i.e. 

p(x(fc - N)\Y’^-^) ~ N{x, P}. 

The resulting algorithm is called a generalised pseudo-Bayesian filter of order N, GPB(N), and 
requires only parallel Kalman filter computations at each time, rather than r*. In particular, 
for = I we obtain the GPB(I) filter which summarises the mixture PDF (22) to time /c — 1 by a 
single Gaussian density and calculates r KF estimates at time k, collapsing this r-term mixture to 
a single Gaussian PDF. The probabilistic data association filter is analogous to the GPB(I) filter 
with the replacement of mode hypotheses by target/clutter associations. 

The GPB(2) filter would consider the possible Kalman filter estimates based on the last 
two manoeuvre modes {M{k — l),M{k)} starting with a prior Gaussian density at time k — 2. 
It then recondenses the resulting mixture of terms to a single Gaussian density at time k. In 
other words, the GPB(2) filter carries the state estimate and covariance at time k — 2 and the 
r mode-conditioned state estimates and their covariances at time fc — I, running each of the r 
conditional estimates through r mode-matched Kalman filters at time k. Obviously this procedure 
quickly becomes unworkable, although it is generally accepted that near-optimal performance is 
obtained, at least in good SNR conditions, with GPB(2). 

Instead of combining the mode-conditioned estimates at the end of the filter cycle, as in 
GPB(2), it is possible to run only r Kalman filters in parallel, each with an appropriately weighted 
combination of state estimates as a “mixed initial condition. This reduces the amount of processing 
almost to that of the GPB(l) approach while obtaining performance near that of the GPB(2) 
approach. This idea is the basis of the interacting multiple-model (IMM) algorithm [31]. Returning 
to the mixture density (22), we have 


p(x(fc)|r'=) = '^yj{k)p{x(k)\Mj{k),y{k),Y'^ ^). 
i=i 


Now, by definition 


p{x{k)\M,{k),y{k),Y’^-^) = 




Gonditioning on Mi{k — 1), it follows that 

r 

p{x{k)\M,{k),Y'^-^) = ^Pr(M,(fc-l)lM,(fc),y'=-i)p(a;(fc)|M,(fc),M,(fc-l),y'=-i) (23) 

r 

« '^fj,i\jik - l\k - 1) p{x{k)\Mj{k), Mi{k - l),Xi{k - l\k - l),Pi{k - l\k - 1)) 


i=l 


where yi\j{k — l\k — 1) = Pr(Mi(fc — l)\Mj{k),Y'‘ ^) and the approximation rests on taking the 
mode-conditioned Kalman filter estimates {xi{k — l\k — 1), Pi{k — \\k — 1)} I = 1,..., r as sufficient 
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statistics for the data The mixture PDF in (23) is then approximated by a Gaussian mixture 

r 

p{x{k)\M,{k), - l|fc - 1) N{x{ky,xi{k - l\k - l),pnk - l\k - 1)} (24) 

i=l 

where 

x{{k — l\k — l) = Yi{x{k)\Mj{k),Xi{k — l\k — 1), Pi{k — l\k — 1)} 

P^{k — l\k — 1) = Cov{x{k)\Mj{k),Xi{k — l\k — 1), Pi{k — l\k — 1)} 

are the Kalman filter estimates calculated in the GPB(2) approach (we will see that these are 
not required in the IMM algorithm). The mean of the Gaussian mixture in (24) is 

r 

x^{k — l\k — 1) = fJ^i\j{k — l\k — 1) Fj{x{k)\Mj{k), Xi{k — l\k — l),Pi{k — l\k — 1)} 

r r 

= ^{x{k)\Mj{k),'^fi,ijXi, cov{y^/r,|jXi}} 

r 

= - i)^»(fc - iifc -1) 

i=l 

by linearity of the Kalman filter (be., summing many KF estimates is the same as applying a single 
KF to a sum of estimates). The covariance of (24) is 

r 

Pj{k — l\k — 1) = k'i\j{k — Mk — 1) {Pi{k — l\k — 1) + Xi{k — l\k — 1) Xi{k — l\k — 1)'} 

i=l 

— x°{k — l\k — l)x°{k — l\k — 1)' 

Only the first two moments Xj(k — l\k — 1) and P°(fc — l|fc — 1), j = 1,...,r, of the mixture (24) 
are retained in the IMM. 

The mean and covariance of the density in (22) can then be computed by r Kalman filters each 
tuned to a different mixed initial condition. Each KF in the bank of r produces its estimates via 

{3pj{k — l\k — 1), Pj {k — l\k — 1)} ^ Kalman Filter {xj{k\k), Pj{k\k)}. 

The conditional state estimates are combined in the usual way to give the overall state estimate 
and covariance 

r 

x{k\k) = Ylnj{k)xj{k\k) 

r 

P{k\k) = fij{k){Pj{k\k) + Xj{k\k)xj{k\ky} — x{k\k)x{k\ky. 

i=l 

Note that the r estimates and covariances Xj{k\k) and Pj{k\k) must be stored as they are needed 
in the next iteration of the algorithm. To complete the description of the IMM algorithm, we need 
to develop a recursion for the mixing probabilities and evaluate the mode probabilities fJ,j{k). The 
mixing probabilities are computed with an application of Bayes’ rule as 

fi,y{k - l\k - 1 ) = c~^p,j^i,yk - 1), i, j = 1,... ,r 

where Cj is a normalisation constant given by 

r 

Cj = - 1). 

2=1 
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The mode probabilities are computed as in section 4.1 


Mj(fc) = c - 1), j = 1,... ,r, 

i=l 

in which the likelihood function for mode j is evaluated as 

A,{k)=p{y{k)\M,{k),Y>‘-^)=N{yik);y^{k\k-l),S^{k)} 
where the predictions for mode j are based on mixed initial conditions, i.e., 

y^k\k-l) = HFx°{k-l\k-l) 

S^k) = HP^k\k-l)H' + R 
P^k\k-1) = FP^{k-l\k-l)F' + Q. 

The mode probabilities Hj{k) must also be stored during the processing. An attractive property 
of the IMM algorithm for manoeuvring target tracking is that it does not require an explicit 
manoeuvre detector since a range of possible manoeuvres are built into the model and these are 
selected by a probabilistic weighting. 

In [16, 10] a two-model and a three-model IMM filter are compared with the standard input 
estimation method and the variable-dimension filter for tracking a target executing a 90 degree 
turn. The models were taken to be: Mi constant-velocity, M 2 Wiener process acceleration model 
( 20 ) with acceleration increment q = 0 . 001 , M 3 constant acceleration model with zero process 
noise. A Monte Carlo simulation showed a substantial reduction in position error for both IMM 
filters during the turn, with a factor of two decrease in RMS position error during constant-velocity 
periods. The complexity of the input estimation filter was around 10 times that of the three-model 
IMM filter. It is claimed that the results are not very sensitive to the choice of Markov transition 
probabilities pij as long as the matrix remains diagonally dominant. Adjustment of the (diagonal) 
transition probabilities merely trades off the peak error during the manoeuvre with the RMS error 
for constant-velocity tracking. However in [50] it is shown that performance of the IMM algorithm 
may depend strongly on the choice of transition probabilities for discrimination of the correct 
target manoeuvring regime. It is also indicated that careful selection of the different manoeuvre 
models is required. 

It is clear that the choice of models in the IMM is an important implementational consideration. 
In particular the “dynamic range” of the set of models should be sufficient to give an adequate 
description of the anticipated target dynamics. In [85], a method for implementing IMM filters 
with variable structure was proposed. The algorithm adapts the models used in an IMM filter over 
a discrete set. This avoids over-parametrising the dynamics (which can be as bad as having too few 
models) while retaining sufficient coverage for good tracking. The case of a continuum of models 
was treated in [90, 118]. In [57] the need for selecting the best model set was also mentioned, 
although the solution presented there was iterative rather than adaptive. 

A comparison of the IMM algorithm and a Viterbi algorithm (VA) (applied to solve the ma¬ 
noeuvre association problem) for a system with multi-level white process noise was covered in [ 8 ]. 
Their conclusions were: 1) the performance of both the IMM and the VA depends monotonically 
on the (maximal) difference between the discrete accelerations Ui and on the sampling time, and 
inversely on the measurement noise; 2) the VA is generally outperforms the IMM algorithm for 
high sampling rates, low measurement noise and a large number of discrete accelerations; but 3) 
the IMM provides better state estimation immediately following the onset of the manoeuvre. 

4.5 Two-Stage Kalman Filter 

A well-known application of Kalman filtering is the simultaneous estimation of a dynamic process 
with a constant, or slowly-varying unknown bias that is correlated with the state. The dynamical 
state is augmented by the constant and the estimation is performed in the usual way. This technique 
has been applied to estimate the acceleration of a manoeuvring target by treating the target 
acceleration as a bias term on a constant-velocity model [3]. We now summarise the approach. 
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Consider the following system description 


x{k -1- 1) 

= Fx{k) + Gu{k) + v{k) 

(25) 

u{k -1- 1) 

= u{k) + n{k) 

(26) 

yik) 

= F[x{k) + w{k) 

(27) 


where v{k), n(k), w(k) are zero-mean, white Gaussian noise sequences with covariance Qy, Qn 
and R respectively, v{k) and w{k) are uncorrelated, and v{k) and n{k) are jointly Gaussian with 
covariance E{v{k)n'{k)} = Qvn- Another way of writing (25) is 


x(k + 1) 


■ F 

G ' 

x{k) 

+ 

v{k) 

u{k + 1) 


0 

I 

u{k) 

n{k) 

y{k) = [ 

H 

0 ] 

x{k) 

u{k) 

+ w{k) 


Under certain observability/controllability conditions on the system matrices [5], the system (28) is 
stable in the sense that the covariance of the Kalman filter converges to a unique positive-definite 
solution. From a practical standpoint, it may be undesirable to increase the dimension of the 
Kalman filter. However, it is also possible to write the recursions implied in (28) as a two-stage 
system: the first stage is a Kalman filter for the system (25) assuming zero bias {u{k) = 0), the 
second stage is a filter based only on the bias term u{k). The outputs of the stages are combined 
to yield the same estimate sequence as that which would be obtained by an augmented filter for 
(28). 

The bias-free filter produces xo{k\k) according to the recursions below: 


xo{k\k — 1) 
xoik\k) 
i^o{k) 

Poik\k - 1) 
Poik\k) 
Woik) 
So{k) 


Fxo{k — l|fc — 1) 
xoik\k - 1) -I- Wo{k)i^o{k) 
y{k) - Hxo{k\k - 1) 
FPo{k-l\k-l)F' + Qo 
iI-Wo{k)H)Poik\k-l) 
Po{k\k-l)H'So\k) 
HPo{k\k-l)H' + R, 


for some covariance Qo yet to be dehned. The bias filter computes its estimate via: 


u{k\k — 1 ) 
u{k\k) 
Pu{k\k - 1) 

Pu{k\k) 

Wu{k) 

Su{k) 


u{k — l\k — 1) 

u{k\k — 1) -I- Wu{k)iyo{k) — C{k)u{k\k — 1) 
Pu{k - l\k - 1) + Qu 
{I-Wy{k)Cik))Pyik\k-l) 
Pu{k\k-l)C{kyS-\k) 

C{k)Pu{k\k - l)C'(fc)' -f HPo{k\k - 1)H' + R, 


where the bias gain is computed using 


C{k) = HU{k) 

U{k) = FV{k-l) + G = F{I-Wo{k-l)H)U{k-l) + G 
V{k) = {I -Wo{k)H)Uik). 

The two-stage Kalman filter estimate is formed using the bias-free state and bias estimates 

= xo{k\k) + V {k)u{k\k) 

= Xo{k\k — 1) + U {k)u{k\k — 1) 


x{k\k) 
x{k\k — 1) 
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Pii{k\k) 
Pi2{k\k) 
Pi2{k\k - 1) 
P22ik\k) 
P22ik\k - 1 ) 


Poik\k) + Vik)Pu{k\k)Viky 
V{k)Pu{k\k) 

U{k)Pu{k\k - 1) 

Pu{k\k) 

Puik\k - 1) 


where Pij are the blocks of the covariance matrix for the augmented state {x',u'y. A theorem in 
[3] shows that the two-stage Kalman filter is equivalent to the augmented Kalman filter when 

Qvn = U{k-\-l)Qu 

Qo = Qv-U{k + l)QnU'ik + l)>0. (29) 


The positive semi-definiteness of Qo is required for stability of the filter. 

The overall complexity of the bias-free and bias filters is less than that of the augmented Kalman 
filter in most cases of interest. The operation of the two-stage filter is akin to a variable-dimension 
filter with a higher-order (acceleration) estimator that can be switched off in quiescent mode. A 
standard exponentially-weighted innovations manoeuvre detector (section 3) is used to detect the 
onset of the manoeuvre. If the effective window length is A, and a manoeuvre is detected at time 
k, the acceleration (bias) filter, but not the bias-free filter, must be initialised (retrospectively) at 
time fc — A to correct the constant-velocity filter estimates. The covariance Qo is also increased 
during the manoeuvre. Termination of the manoeuvre is sensed by monitoring the innovations 
of the bias-free filter. In a simulation in [3] the two-stage Kalman filter was compared with the 
variable-dimension filter. The results indicated that the estimation errors were similar before and 
during a manoeuvre, but the two-stage filter detected the end of the manoeuvre more rapidly. 

Regarding initialisation of the two-stage Kalman filter, the initial bias estimate is taken to be 
uncorrelated with the initial bias-free state estimate 


Pi2(0|0) = 0 ^ K(0) = 0, U{0) = 0. 

The bias-free process noise Qo (29) sets the desired response of the constant-velocity filter; the 
bias filter process noise Qu determines the manoeuvre response. 

The two-stage Kalman filter has been applied within the IMM framework by [97, 96] with the 
objective of making the assumed target acceleration a variable parameter in the IMM. In this way, 
only two filters per co-ordinate, rather than several fixed-acceleration models, are required to cover 
the possible range of target motions. The results of this study indicate similar performance at 
lower complexity compared with the standard IMM approach. A difficulty is the delay required by 
the two-stage Kalman filter in estimating the manoeuvre acceleration, although this is somewhat 
alleviated by the subsequent matching of the IMM model to the target acceleration. 

In [25] an interacting multiple model algorithm with bias estimation was proposed, again based 
on a two-stage Kalman filter. By using only bias filters in the IMM as opposed to augmented-state 
Kalman filters, a complexity reduction is achieved. A simulation was provided for an IMM with 
3 bias models corresponding to: zero bias (constant velocity), constant non-zero bias (constant 
acceleration), and constant bias with a constant-speed constraint. The performance obtained was 
similar to a 3-model IMM filter while requiring roughly 50% of the computation. 

Lastly an interacting acceleration compensation (lAC) technique was put forward in [144] as a 
means of obviating the requirement for manoeuvre detection of the two-stage Kalman filter. The 
lAC technique, illustrated in Fig. 4 (from [28]), assumes a two-stage estimator with a bias-free 
(constant-velocity) filter and two acceleration (bias) models: one for a constant-velocity target and 
one for constant acceleration. Since the IMM does not employ a conventional manoeuvre detector, 
it can provide an acceleration estimate in real time with which to compensate the bias-free filter. 
The lAC algorithm operates at roughly half the computational cost of an IMM filter with two 
models, but provides similar performance. 
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X^(k-1 Ik-1) 


X2(k-1Ik-1) 



x(k|k) x^(k|k) X 2 (k|k) ^(k) 

Figure 4: Block diagram of the interacting multiple model algorithm with acceleration compensation. 


4.6 IMM Algorithm for Fixed Interval Smoothing 

A fixed-interval smoothing approach to manoeuvring target tracking has been derived in [63], 
following earlier work by [56, 32]. The forward-running and backward-running Kalman filters in 
the usual fixed-interval smoother are replaced by interacting multiple model filters, together with 
a technique for fusing the conditional estimates from the two filters. The backward-running filters 
are obtained by time-reversal of the corresponding forward-running filters. Although the proposed 
algorithm is a batch algorithm with high complexity, its high performance makes it useful as an 
estimator for generating benchmark tracks in ground truthing or for sensor alignment in multi¬ 
sensor tracking systems. 

In the notation of section 4.4, assuming r models, suppose that at time k model Mi{k) is in 
effect for the forward filter with the backward filter assuming model Mjik 4-1). The conditional 
state “predictions” and their covariances are computed as xf {k\k — 1), Pf {k\k — 1), xf{k\k — 1), 
PP{k\k — 1). Assuming a fixed interval of size N, the predictions are used to obtain fused initial 
estimates according to 

x%{k\N) = P^^{k\N)[{Pnk\k - l))-Hf{k\k - 1) + {P^{k\k - l))-H’^{k\k - 1)] 

P^^{k\N) = {pP{k\k-l))-^ + {P^{k\k-l))-\ 

These quantities are then mixed to yield prior state and covariances for the Kalman smoother 
matched to model Mj{k) 

r 

= ^M,T(fc+i|iv)4(fc|iv) 

P^ik\N) = ^M,T(fc + l|^)[^°(fc|iV)+4(fcliV)4.(fc|A^)']-x°(fc|iV)^ 
t=i 

The mode probabilities fj,j{k\N) are updated via the smoothed measurements yj{k\N) from smoother 
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Mj{k). Finally the conditional estimates are combined to give 


x{k\N) = Y.P^Am)i3{k\N) 

i=i 

The IMM smoother was compared under simulation in [63] with a single model (constant-velocity) 
smoother and yielded similar performance, although the former method seemed to produce larger 
spikes at the manoeuvre onset times. 

4.7 Expectation-Maximisation Algorithm 

This technique, from [106], utilises multi-level process noise of the form (3) to model the unknown 
target accelerations. A zero acceleration level is included for a constant-velocity target. We give 
only a brief description of the technique here. 

A length K batch of uncluttered target measurements is assumed available for processing. The 
expectation maximisation (EM) algorithm [48, 19, 93] is applied to the problem of estimating the 
MAP sequence of target accelerations ■. 

arginax p(A^,y^,C/^) (30) 

where denotes the (unknown) state sequence of length K and the measurement sequence. 
This results in a multi-pass, batch estimator of . At each pass an objective function is evaluated 
(the E step) and then maximised (the M step). The expectation step involves computation of state 
estimates from a bank of Kalman smoothers tuned to the possible manoeuvre sequences. The 
maximisation step is efficiently implemented using forward dynamic programming. 

An on-line estimator is also derived using a modihed EM-type cost function. To obtain a 
dynamic programming recursion, the target state is assumed to satisfy a Markov property with 
respect to the manoeuvre sequence. This results in a recursive but sub-optimal estimator im- 
plementable on a Viterbi trellis. The transition costs of the latter algorithm, which depend on 
filtered estimates of the state, are compared with the costs arising in a Viterbi-based manoeuvre 
estimator developed in [8]. It is shown that the two criteria differ only in the weighting matrix of 
the quadratic part of the cost function. 

Testing of the batch EM manoeuvre tracking algorithm (reported in [109]) has demonstrated 
superior transient error performance during manoeuvres compared with the recursive version, which 
has errors of similar magnitude to the approach in [8]. The false manoeuvre alarm performance of 
the latter algorithm was the best of the three techniques tested in [109]. 

5 Manoeuvring Target Tracking in Clutter 

Tracking a constant-velocity target in the presence of false measurements or clutter involves solving 
the data association problem. This is the problem of deciding which, if any, of a number of candidate 
detections is more likely to have arisen from the target of interest. The data association problem 
involves prediction of the measurement to the next scan followed by a process that correlates 
measurements with the prediction. In heavily cluttered environments it is well to apply gating to 
reduce the number of plausible target measurements to a reasonable number for processing. The 
process of gating or measurement validation is covered in [51, 24, 9] and illustrated in Fig. 5. 

Since the optimal (Bayesian) solution [120] to the data association problem has combinatori- 
ally increasing computational requirements, there are many sub-optimal approaches of which the 
nearest neighbour Kalman filter, probabilistic data association (PDA) [12], the track-splitting fil¬ 
ter [122], and the multiple-hypothesis (MHT) filter [113] are among the more common. A block 
diagram of the PDA filter is given in Fig. 6, although the same structure applies to any single-scan 
Bayesian algorithm for state estimation. 

As we mentioned in the Introduction, the problem of tracking a manoeuvring target is funda¬ 
mentally at odds with the data association problem. This is because any method that employs 
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PREDICTED MEASUREMENT 
y ( k+1 I k ) 



DETECTIONS • 


Figure 5: Gating is applied to measurements to reduce the processing required for tracking in a cluttered 
environment. The gate is centred on the predicted measurement. 


distance from a predicted measurement (z.e., the filter innovation) to determine the onset of a 
manoeuvre may be falsely triggered in the presence of nearby clutter detections. In this section we 
review the optimal Bayesian approach to tracking a manoeuvring target in clutter and its natural 
sub-optimal realisations. We also outline some adaptive PDA-based schemes (variable-dimension 
PDA and IMM-PDA). We also describe some approaches that take advantage of signal amplitude 
distributions to improve the discrimination of target from clutter. These approaches can be in¬ 
tegrated at low cost into most existing tracking filters. The discrimination of false alarms from 
target measurements can also be aided by consistency testing of velocity and/or and acceleration 
estimates in addition to the filter innovation. 


5.1 Optimal Bayesian Filter for Manoeuvring Target in Clutter 

We present a derivation of the optimal Bayesian filter (OBF) [72] in this part. The manoeuvring 
target model (3) presented earlier is modified for the case of cluttered measurements as 


x{k + 1 ) 


y{k) 


F{k)x{k) -\- G{k)ui{k) + v{k) for model 1 
F{k)x{k) + G{k)u 2 {k) + v{k) for model 2 


F{k)x{k) -I- G{k)ur{k) + v{k) for model r 

H{k)x{k) + w{k) for the target 
clutter otherwise. 


(31) 


The target accelerations u{k) are a finite-state Markov chain with known transition probabilities 
Pij, with Ui{k) denoting the event {u{k) = Ui}, i = l,...,n. The usual notation for cluttered 
measurement sets is adopted: Y{k) = {yi{k),... ,ymk{k)} (at scan k), = {Y{1),... ,Y{k)} 

(measurement set up to time k). The association event 9i(k) signifies the event that measurement 
yi{k) is due to the target (f = 1 ,..., m^), or no measurement is from the target {i = 0 ). 

Seeking to evaluate the probability of a particular joint measurement association and manoeuvre 
sequence, we define the Ith possible measurement history (recursively) as 

0f = {0^1,0,,(*)}, l = l,...,Lk 

where Lk = (1 + rni){- • •)(! + mk), and the pth possible manoeuvre history as 

= p=l,...,nk 
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Figure 6: Block diagram of a probabilistic data association filter. The same processing applies to any 
algorithm that approximates the measurement density by a single Gaussian at each scan. 


The set of joint measurement and manoeuvre association events is x^p = {©f: } iii which there 

are elements! 

Writing xfp as {x^q^jXipik)} where xipi^) = {Siiik),Uip{k)}, we obtain the conditional mean 
estimator for x(k) as 

n'” Lk 

x(klk) = E{a;(fc)|y'=} = EE /3ip(k) xip(klk) (32) 

p—1 p—1 

where the conditional state estimates are defined as xip(klk) = E{x(fc)|xfp}- The association 
probabilities f3ip{k) = Pr(xfp|b"^) satisfy a recursion, namely 

in which Ck is a normalisation factor. Furthermore the terms on the right hand side are evaluated 
as 




V^^’‘+^Pa^N{y,,{ky,ysq{k\k - l),Ssqm > 0, 


where ysq{k\k — 1) = E{y{k)\Xsy ^and its covariance Ssq{k) are computed by Kalman 
filtering the sth measurement sequence assuming the gth manoeuvre history, and Vq is the volume 
of the validation gate at time k. The computation of the association probabilities is completed 
with 

Pr(x/p(fc)lx",-'>^"”') = - 1) = Pr(0u(fc)|r'=-i) 


and 


Pr( 0 ,,(fc)|r'=- 1 ) 


c ^;;^PDPG 5 c(TOfe - 1) f; = 1, . . . , TTlfc 
c~^ {l - PdPg) 9c{mk) ii = 0, 


where Pd is the target detection probability, Pq the gate probability and it is customary to assume 
that the number of clutter points in the gate is given by a Poisson distribution 


gc{m) = exp(-AV'G) 


{War 

ml ’ 


m = 0 , 1 ,... 
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The state error covariance is computed as 


P{k\k) = EE Pipik) xip{k\k) [Pip{k\k) + Xip{k\k)xip{k\kY] - x{k\k)x{k\ky. 

p—1 p—1 

The optimal Bayesian filter (32) is of course not realisable due to its increasing memory and 
computational requirements. There exist (N, M) scan approximations to it that lump measurement 
histories identical over the previous N scans and manoeuvre histories identical over the previous 
M scans (see [72]). These techniques amount to matching a single Gaussian density to the mixture 
(32) at the appropriate time. Note that the MAP state estimator would take only the estimate 
xip{k\k) corresponding to the maximum association probability l3ip(k) at time k. 

5.2 Single-Scan Psendo-Bayesian Filter 

In [57] a sub-optimal Bayesian adaptive filter for a manoeuvring target system of the following 
form is derived: 

a;(A:-I-1) = F{k)x{k) + v{k), v{k) N{0,Q{k)} 

_ f H{k)x{k) + w{k) w{k) ^ N{0,R{k)} for the target 
( clutter otherwise. 

In this formulation the process and measurement noise covariances are unknown and take values 
in a discrete set 

Q{k) € {Qi ,..., Qp}, R{k) € {Ri, ■. ■, Ri}. 

Let 4>ij{k) denote the event that at time k {Q{k) = Qi,R{k) = Rj}, and define the association 
events Oi{k) i = 0,1,..., nik as before. It follows that the conditional mean estimator of the state 
is expressible as 


p q rrik 

Hk\k) = ^^Pr(</>,,(fc)lr'=)^E{a:(A:)|0,(fc),0y(A:),y'=} 

j=l 1=1 i=0 

j=i 1=1 

where, following the usual pattern, 


rrik 

Xjiik\k)=Y,Pvi{k)E{x{k)\eYk),^ij{k),Y'^}, 

i=0 

and 

Pi,i{k) = PTi9Yk),^ijik)\Y>^). 

This multiple-model PDA technique is also described in [11]. 

The filter is made practicable by summarising the prior state density based on Y^~^ by a 
single Gaussian with mean x{k — l|fc — 1) and covariance P{k — l|fc — 1) (as in the GPB(l) or 
PDA approaches). Despite this single-scan approximation of the Gaussian mixture density, the 
computational requirements of this adaptive PDA filter remain high. In particular it is difficult 
in practice to determine a suitable grid size for discretisation of the covariance matrices. In a 
bearings-only tracking example for a ship travelling in a non-straight course with an average 10 
clutter measurements per look, [57] used p = 6, q = 6 cells, or a total of 36 PDA filters. 
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5.3 Joint Manoeuvre and Measurement Association 

A similar approach to the preceding section was taken by [117, 78] for tracking multiple manoeu¬ 
vring targets in clutter, with [82] covering in the single-target case. A multi-level white noise 
acceleration model was used with the input a finite Markov chain u{k) G {ui,..., Um} with known 
transition probabilities pij. Gating was applied to validate measurements for tracking. The filter 
derivation, again based on a single-scan Gaussian approximation, is briefly summarised below. 

Let Oi{k) denote the fth association event and Uj{k) the jth manoeuvre model. The association 
probabilities are computed by invoking the independence of the measurement and manoeuvre 
associations, viz. 

13,,(k) = Pr(0,(fc),u,(fc)lr'=) 

= c-ip(r(fc)|d,(fc),u,(fc),r'=-i)Pr(d,(fc),u,(fc)ir'=-i). 

The first term on the right is calculated as in standard PDA. The last term in the expression is 
Pr(0,(fc),u,(fc)|y'=-i) = Pr{e,{k)\uj{k),Y'^-^)Pi{u,{k)\Y'^-^) 

m 

= PY{e,{k)\Y^-^)Y,pi, PT{ui{k - i)ir'=-i) 

1=1 

whence standard PDA-type calculations can be used to complete the derivation. The state estimate 
is given by 

rrifc m 

x{k\k) = ^^l3ij{k)xi,{k\k) 

i=0 j=l 

The simulation results in [117] assume a high probability of detection Pd = 0.95 and a very low 
clutter density of 0.1-0.2 returns in the gate on average. For this low clutter case, the technique 
appears to be able to track multiple manoeuvring targets that overlap, although the estimation 
accuracy is degraded during manoeuvres. The results in [78], which assume Po = 1 and PpA = 0.1 
and 6 possible target accelerations, are hard to interpret. It is also unclear how the probability of 
false alarm indicated in the simulations translates to the usual clutter density. 

5.4 Variable-Dimension PDA 

Variable dimension PDA [23] is a direct extension of the variable-dimension filtering approach 
described in sections 3 and 4.3 to the case of cluttered measurements. Clutter is taken into account 
by replacing the usual Kalman filters for constant-velocity and constant-acceleration targets with 
PDA filters, with the idea that the constant-velocity PDA filter is maintained until a manoeuvre 
is detected at which time a constant-acceleration model takes over. The difficulty in this type of 
approach is the reliable detection of a manoeuvre in the presence of false measurements. A series of 
statistical tests based on the normalised filter innovations are needed to solve this problem. Since 
there is more than one measurement at each scan, there are many different sequences of innovations. 
The method is therefore to test all possible sequences of innovations {pi(j)}, j = k — N + 1,... ,k 
over a window of length N and initiate a new constant-acceleration PDA filter each time a sequence 
is found that satisfies the following tests. 

1. Gating: {pi{j)} should be contained in a series of gates of increasing size. 

2. Significance of the accelerations estimate: the innovations are white and zero-mean for a 
non-manoeuvring target, a target acceleration corresponds to correlation in this sequence. 
The presence of a non-zero acceleration is tested at a given significance level. 

3. Goodness of fit test for the acceleration model: the MMSE of the residuals is computed 
allowing for the estimated acceleration. 

4. If the previous tests are all satisfied, a measurement is expected at time fc -I- 1 near the 
prediction based on the acceleration estimate. This is used to initiate a higher order Kalman 
filter which is then continued after time fc -I- 2 using PDA to track the manoeuvre in clutter. 
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Since an innovation sequence corresponding to false alarms may pass all the above tests, the 
constant-velocity PDA filter is continued along with any manoeuvring PDA filters. This decreases 
the risk of track loss in clutter. 

Track maintenance rules are provided in [23] for terminating and merging the extra tracks that 
are produced by this algorithm. The finish of the manoeuvre is detected by testing innovations in 
the gate of the PDA filter assuming a zero acceleration. Although the technique does not require 
retrospective initialisation, many PDA filters are needed to track a manoeuvring target in moderate 
clutter. 

The performance of the variable-dimension PDA tracker is reported to be reasonable in mod¬ 
erate clutter densities (0.024 clutter detections on average in a 2ax x 2ay measurement noise cell). 
In addition to the large number of filters that have to be maintained to minimise track loss, there 
are several thresholds that need to be set for the statistical tests described above. 

5.5 IMM-PDA 

A natural extension of the IMM algorithm for tracking a manoeuvring target in a cluttered envi¬ 
ronment appears in [30, 66]. This technique, called interacting multiple-model probabilistic data 
association (IMM-PDA), replaces the standard Kalman filters in the IMM algorithm (section 4.4) 
with PDA filters. The target models can be taken as constant-velocity and constant-acceleration 
for the manoeuvring target case, or constant-velocity and “no target” (non-existent target) models 
for the algorithm in [14, 15] which is designed for automatic track initiation and tracking in clutter. 
(The technique is clearly not restricted to just two models.) The transitions between the models 
are Markov with known transition probabilities. The major difference in the IMM computations 
is that the mode probabilities are formed using the PDA “likelihood” function 

A,(fc) = p(y(fc)|M,(fc),r'=-i) 

= Ke-™'=(1 - PdPg) + Va"^>^+^—N{yi{ky,Mk\k - l),Sy{k)} 

nik 

Uk\k-l) = E{y{k)\M,{k),Y'^-^} 

where the symbols have usual meanings. The prediction yj(k\k — 1) is obtained from the IMM 
filter for model Mj(k). The other computations are identical to the standard IMM algorithm. The 
performance of the IMM-PDA filter appears to be good for its level of complexity. 

A further variation on this theme is provided in [64] which uses “integrated PDA” filters instead 
of PDA filters in the IMM-PDA algorithm, leading to the title IMM-IPDA. The integrated PDA 
filter [99] incorporates a target existence model and hence provides a track confidence measure. 
The target existence model is identical to the one in [44], although the association probability 
calculations are marginally different, replacing the usual mk term in PDA by an expected number 
of measurements in the gate rrik- The IMM-IPDA algorithm has essentially the same complexity 
as the IMM-PDA algorithm and the track confidence measure assists in automatic track formation 
and maintenance. Simulations evidenced in [64] point to acceptable performance against constant- 
velocity, constant-speed turning and linearly accelerating targets in moderate clutter. 

In [143] the IMM-IPDA algorithm was put forward as a solution to the second benchmark 
problem for manoeuvring target tracking in the presence of clutter and counter-measures. The 
algorithm also monitors the predicted position error tx and automatically adjusts the radar revisit 
time to ensure that Cx does not exceed a threshold. 

An additional modification of the IMM-PDA idea appeared in [98] called integrated probabilistic 
data association with prediction-oriented multiple models (IPDA-PMM). The method uses a com¬ 
mon prediction equation across all models to simplify the computations. Simulations for a slowly 
manoeuvring target in low density clutter show modest improvements over a constant-acceleration 
PDA filter. 
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5.6 Multi-hypothesis Techniques 

Multi-hypothesis tracking (MHT) is a high performance, “measurement-oriented” multiple target 
tracking technique developed in [113]. Although not originally considered in the MHT framework, 
more recent work on MHT has focussed on the incorporation of manoeuvres. A detailed description 
of MHT is contained in [24] and we need only mention its essential features. MHT is a Bayesian 
algorithm that computes state estimates for all measurement hypotheses and their corresponding 
posterior probabilities. The hypothesis set allows for a measurement to be due to: (i) an existing 
target; (ii) a false alarm; or (iii) a new target. The inclusion of the third hypothesis allows MHT 
to initiate new target tracks automatically. 

Due to the very high computational requirements of the MHT approach, efficient pruning of 
the decision tree is needed (see references in [76]). This is effected by clustering non-competing 
measurements and tracks, combining tracks with similar state estimates, deleting low-confidence 
tracks, pruning based on prior information (manoeuvrability constraints), and preventing initiation 
on measurements that have a high correlation to existing tracks. 

The inclusion of target manoeuvres in MHT has been approached in [76] via a correlated-noise 
acceleration (Ornstein-Uhlenbeck) model in the context of formation tracking. The IMM and GPB 
algorithms have been applied within the MHT framework in [74] to represent the PDF sum over 
mode histories by finite Gaussian mixtures. A performance comparison is given for the IMM, 
GPB(l), GPB(2) and a MHT-IMM filter with truncation depth of 3 scans. It is concluded in [74] 
that the 3 scan-back approximation is near-optimal for the benchmark tracking problem [27]. The 
same author also applied fixed-lag Kalman smoothing or retrodiction to improve the state estimates 
obtained by the MHT-IMM algorithm and this is reported in [75]. An IMM-MHT algorithm called 
“IM3HT” has also been reported in [136]. The IM3HT algorithm is a natural embedding of IMM 
in the MHT framework using multiple models to cover possible target accelerations and multiple 
hypotheses to allow for false alarms and multiple targets. Comparisons of IM3HT with a MHT 
algorithm incorporating manoeuvre detection logic are given for target accelerations of up to 5 g 
for detection probabilities of 0.8 and 1.0. 

5.7 Filters Using Amplitude Information 

In the same way that Doppler frequency is used to enhance tracking and track initiation perfor¬ 
mance over techniques employing only position information, several authors have investigated the 
possibility of using signal amplitude information (or power, SNR, etc.) to increase the ability 
of the tracking algorithm to discriminate target measurements from clutter. More generally, any 
non-dynamical “feature” information (for instance target orientation, etc.) could be used for this 
purpose, if it is available. The paper [49] describes a distribution-free procedure for target detection 
in track-while-scan and phased-array radars. The detection procedure is distribution-free because 
it uses only the “rank” (or ordering) of the received measurement to determine whether a target 
signal is present or absent. Thus if the rank of the measurement is Zij in range bin i and beam 
position j (and at time k), a signal is declared present if Zij > T or absent otherwise where T is 
the detection threshold. 

The probability of false alarm for such a procedure depends only on the number of reference cells 
over which the ranking takes place, and not on the signal and noise distributions Pr(Zy = R\S+N) 
and Pr(Zy = R\N). The latter distributions are needed, however, for computing the detection 
probability. 

The use of “rank” information, as described in [49] was applied to enhance the performance 
of the PDA filter for tracking a manoeuvring target in clutter [100]. They also consider an ad 
hoc procedure for adapting the detection threshold to trade off computation (due to excessive 
clutter) and detection performance. The only algebraic difference is in the calculation of the 
association probabilities for PDA, which in this case depend on a likelihood ratio (we will detail this 
modification shortly). The signal plus noise amplitude distribution was assumed to be Rayleigh, 
corresponding to a Swerling type-2 target [126]. In simulations at probabilities of detection between 
0.6 and 0.9, performance of the amplitude-aided PDA filter was compared with that of a (constant- 
acceleration) PDA filter for tracking a target executing a constant-speed turn. Apart from the 


29 



obvious advantage of good quality signal amplitude information, it is claimed that the method 
in [100] can track a manoeuvring target in clutter densities as high as 10 points (average) in the 
validation gate. 

Similar work on the inclusion of amplitude information in PDA was carried out in [83], and 
we now outline the basic approach. The probability distributions Pi(-) and Po(') of the received 
signal envelope a(k) under the signal present Hi and signal absent ido hypotheses are assumed to 
be known. The system model uses an augmented measurement vector yaik) defined by 


ya{k) 


y{k) 

a(k) 


The state vector is not augmented, although this could be accomplished if filtering of the signal 
amplitude is required. The equations of the PDA filter are unchanged except for the computation 
of the conditional measurement density, which now must allow for the different probability densities 
of target and clutter measurements: 


Mk)\e,{k),Y’^) 


PG^N{yi{k)]y{k\k - l),S{k)}pi{a{k)) i = l,...,mk 
Vc^Poiaik)) i = 0 


This introduces a likelihood ratio into the calculation of the association probabilities (once they 
are normalised). Effectiveness of the technique relies on the accuracy with which the respective 
amplitude distributions are modelled. 

Signal amplitude information was also included in the IMM-PDA algorithm in [84]. This uses 
the likelihood ratio arising from the signal-plus-noise and noise-only distributions to alter the PDA 
association probabilities as illustrated above. The modification is useful for enhancing track forma¬ 
tion and tracking of manoeuvring targets in clutter through more effective signal discrimination. 
In the same paper a track acceptance test that uses a two-dimensional threshold, depending on 
both the target confidence and the probability distribution for false track duration, is described in 
detail. The target confidence measure is obtained by including a “no target” model in the IMM 
filter and the distribution of false track lifetimes is obtained via Monte Carlo simulation. The 
IMM filter is implemented with three other models: constant-velocity, left-turn and right-turn. 
The performance is claimed to be superior to that of the IMM-PDA filter (section 5.5) especially 
for weak targets and in heavy clutter. 

Amplitude information has also been applied in the context of multi-hypothesis sonar tracking 
[112]. A feature of MHT algorithms is their ability to initiate tracks automatically in clutter, 
as well as allowing for multiple targets. The article [112] describes an adaptive re-initialisation 
procedure for MHT. The state variable includes SNR, bearing, frequency and their derivatives. A 
track confidence test (based on Pd and Pfa) is employed to detect track loss, for instance, due to 
a manoeuvre. The gate is then enlarged for a predetermined number of scans in order to re-acquire 
the target. 


6 Discussion 

We have given an extensive review of the existing literature on manoeuvring target models (section 
2), manoeuvre detection (section 3), tracking of manoeuvring targets (section 4), and tracking of 
manoeuvring targets in clutter (section 5). Although the number of competing techniques is large, 
the number of comparative performance evaluations is small. A recent initiative [27] has been the 
definition of a benchmark manoeuvring target tracking problem for phased array radar. 

Conventional manoeuvring target models we have covered include random input models, un¬ 
known deterministic input models, switching systems and Singer’s correlated process noise model. 
Several extensions to these models have been investigated that use different stochastic represen¬ 
tations or higher order approximations. Manoeuvre detection strategies are characterised by the 
selection of a test statistic based on the filter residuals using data windowing or exponential for¬ 
getting together with a likelihood ratio test. Several generalisations of these tests are available but 
do not appear to have found signihcant application. The use of additional sensors such as imaging 
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sensors is a promising means of enhancing the manoeuvre detection capabilities of short-range 
radar tracking systems. 

If false alarms are to be handled by a nearest-neighbour approach or other correlation test, the 
accepted techniques for manoeuvring target tracking can be classed as multi-level process noise, in¬ 
put estimation, variable-dimension filtering, two-stage Kalman filtering, and sub-optimal Bayesian 
filtering for switching systems including the IMM and GPB algorithms. The problem of tracking a 
manoeuvring target in clutter has been formulated within the framework of Bayesian probability 
theory using (i) a finite state Markov chain manoeuvre input and (ii) a Markov chain switching 
model. The optimal Bayesian filter for both these cases has combinatorially increasing complexity 
and therefore A^-scan truncation is generally applied to simplify the filter implementation. The 
probabilistic data association filter, a single-scan Bayesian algorithm, can be employed to extend 
the variable dimension filter and IMM filter for tracking in clutter. The use of non-kinematic in¬ 
formation such as measurement SNR, when this is reliable, is a promising avenue for measurement 
discrimination in clutter. 

More recent approaches to the manoeuvring target tracking problem include the expectation 
maximisation algorithm and MHT framework and these deserve further comment. The EM tech¬ 
nique, which is a batch algorithm, does not seem to be practicable in the cluttered case without 
substantial modification to avoid enumeration of joint manoeuvre and measurement associations. It 
is however possible to apply ideas from the recent probabilistic multi-hypothesis tracking (PMHT) 
algorithm [124] to simplify these computations, thus obtaining a practicable sub-optimal algorithm; 
the approaches presented in [149] and [88] are examples of this. The key simplifying assumption 
in applying the EM algorithm in this case is the supposition that the target may be associated 
with all measurements in a scan simultaneously [105]. This is exploited via mixing probabilities 
to condense an iV-dimensional sum over all measurement-to-target associations over N scans to 
a single sum. This assumption has no physical basis and also modifies the tracking problem in 
a fundamental manner by assuming away the combinatorial explosion of association hypotheses. 
Numerical simulations of PHMT-based EM algorithms in [149] indicate some improvement over 
the IMM-PDA algorithm (section 5.5) in heavy clutter, although no comparisons with high per¬ 
formance techniques such as MHT or GPB approaches appear to have been effected as yet. Such 
comparisons would need to allow for the advantage of smoothing over filtering, as well as the 
operational consequences of increasing the latency in displaying tracks to the operator. 
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